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WHAT IS CLAIMED IS: 



1 1. A method of operating a system to process image data, 

2 the method comprising: 

3 encoding said image data to generate first 

4 encoded image data; 

5 decoding said first encoded image data to 

6 generate first decoded image data; 

7 analyzing the content of the first decoded image 

8 data to generate indexing information; and 

9 storing the first encoded image data with the 

10 generated indexing information on a digital storage medium. 

1 2. The method of claim 1, wherein the previously 

2 generated indexing information is a first set of indexing 

3 information, the method further comprising: 

4 retrieving the stored first encoded image data 

5 from the digital data storage device; 

6 decoding said first encoded image data for a 

7 second time to generate decoded image data; 

8 analyzing the content of the first decoded image 

9 data to generate a second set of indexing information; and 

10 storing the second set of indexing information 

11 with the first encoded image data and the previously 

12 generated indexing information on the digital storage 

13 media. 



1 



3. The method of claim 2 7 further comprising: 
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2 retrieving the stored first encoded image data 

3 for a second time; 

4 decoding said first encoded image data for a 

5 third time to generate decoded image data; 

6 analyzing the content of the first decoded image 

7 data to generate a third set of indexing information; and 

8 storing the third set of indexing information 

9 with the first encoded image data, and the first and second 
10 sets of indexing information on the digital storage media. 

1 4. The method of claim 1, further comprising: 

2 receiving image data information relating to said 

3 image data prior to performing said encoding step; and 

4 storing, on the digital storage media, the 



5 received image data information with the first encoded 

6 image data and the generated indexing information. 

1 5. The method of claim 4, wherein the received image data 



2 information, first encoded image data, and the generated 

3 indexing information are stored together in a first file on 

4 the digital storage media. 

1 6. The method of claim 5, wherein the digital storage 

2 media further includes : 

3 a second file which includes second encoded image 

4 data, second generated indexing information and second 

5 received image data; and 

6 a file directory, the file directory including: 

7 a copy of said generated indexing 

8 information included in the first file; and 



-60- 

9 a copy of the second generated indexing 

10 information included in the second file. 

1 7. A data processing method, the method comprising: 

2 receiving a first set of encoded data; 

3 decoding the first set of encoded data to 

4 generate first decoded data; 

5 analyzing the content of the first decoded data 

6 to generate first indexing information; and 

7 storing the first set of encoded data with the 

8 first indexing information in a first file on a digital 

9 storage medium. 

1 8. The method of claim 7, further comprising the step of: 

2 receiving a second set of encoded data; 

3 decoding the second set of encoded data to 

4 generate second decoded data; 

5 analyzing the content of the second decoded data 

6 to generate second indexing information; and 

7 storing the second set of encoded data with the 

8 second indexing information in a second file on the digital 

9 storage medium. 

1 9. The method of claim 8, further comprising: 

2 storing in a directory file on the digital 

3 storage medium a copy of the first indexing information and 

4 a copy of the second indexing information. 

1 10. The method of claim 9, further comprising the step of: 

2 retrieving the first set of encoded data from the 

3 digital storage medium; 
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4 decoding the first set of encoded data for a 

5 second time to generate third decoded data; 

6 analyzing the content of the third decoded data 

7 to generate a third set of indexing information; and 

8 storing the third set of indexing information in 

9 a file on the digital storage medium with the first set of 
10 encoded data and the first indexing information. 

1 11. The method of claim 10, further comprising the step 

2 of: 

3 adding a copy of the third set of indexing 

4 information to the directory file on the digital storage 

5 medium. 

1 12. The method of claim 11, further comprising: 

2 retrieving the first set of encoded data from the 

3 digital storage medium for a second time; 

4 decoding the first set of encoded data for a 

5 third time to generate fourth decoded data; 

6 analyzing the content of the fourth decoded data 

7 to generate a fourth set of indexing information; and 

8 storing the fourth set of indexing information in 

9 a file on the digital storage medium with the first set of 

10 encoded data, the first indexing information, and the third 

11 set of indexing information. 

1 13. The method of claim 12, further comprising: 

2 adding a copy of the fourth set of indexing 

3 information to the directory file on the digital storage 

4 medium. 
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1 14. The method of claim 10, wherein the step of analyzing 

2 the content of the third decoded data includes: 

3 analyzing the third decoded data for at least 

4 some information which is different than the information 

5 for which the first decoded data was analyzed. 

1 15. The method of claim 12, 

2 wherein the step of analyzing the content of the 

3 third decoded data includes: 

4 analyzing the third decoded data for at 

5 least some information which is different than 

6 the information for which the first decoded data 

7 was analyzed; and 

8 wherein the step of analyzing the content of the 

9 fourth decoded data includes : 

10 analyzing the fourth decoded data for at 

11 least some information which is different than 

12 the information for which the first and third 

13 decoded data was analyzed. 

1 16. The method of claim 15, wherein the first set of 

2 encoded data includes at least one of encoded audio data 

3 and encoded video data. 

1 17. The method of claim 9, further comprising the step of 

2 receiving search information from a system user; 

3 accessing the directory file to identify stored 

4 encoded data corresponding to the received search 

5 information; and 
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6 retrieving from the digital storage medium 

7 encoded data identified as corresponding to the received 

8 search information. 

1 IS. The method of claim 17, further comprising the step 

2 of : 

3 converting the retrieved encoded data from a 

4 first encoding format to a second encoding format thereby 

5 generating data encoded according to the second encoding 

6 format, the second encoding format being different from the 

7 first encoding format; and 

8 supplying the data encoded according to the 

9 second encoding format to a data distribution system. 

1 19. The method of claim 18, further comprising the step 

2 of: 

3 converting the retrieved encoded data from the 

4 first encoding format to a third encoding format thereby 

5 generating data encoded according to the third encoding 

6 format, the third encoding format being different from the 

7 first and second encoding formats; and 

8 supplying the data encoded according to the third 

9 encoding format to the data distribution system. 

1 20. An apparatus for indexing encoded data including at 

2 least one of encoded audio data and encoded image data, the 

3 apparatus comprising: 

4 a decoder module for decoding the encoded data to 

5 generate first decoded data; 
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6 an indexing module for performing content 

7 analysis on the decoded data to generate information 

8 content indexing information; and 

9 a storage device for storing the generated 

10 information content indexing information in a file with the 

11 encoded data. 

1 21. The apparatus of claim 20, further comprising: 

2 a retrieval module for retrieving from the 

3 storage device the encoded data included in the first file 

4 and for supplying the retrieved encoded data to the decoder 

5 module; 

6 wherein the indexing module indexes decoded data 

7 generated by decoding the retrieved encoded data to produce 

8 second information content information, the second 

9 information content indexing information including 

10 information on different features than the previously 

11 generated information content indexing information; and 

12 means for appending the second information 

13 content indexing information to the file including the 

14 retrieved encoded data. 

1 22. The apparatus of claim 21, further comprising: 

2 means for storing a copy of the indexing 

3 information included in said file with the encoded data in 

4 a file directory stored in the same storage device as the 

5 file including the encoded data. 

1 23. The apparatus of claim 22, wherein the information 

2 content indexing information identifies physical objects 

3 included in images represented by said encoded data. 
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1 24. The apparatus of claim 23, wherein the information 

2 content indexing information identifies words included in 

3 songs stored using said encoded data. 

1 25. A digital data storage device, comprising: 

2 a plurality of data files, each data file 

3 including index information and at least one of encoded 

4 image data and encoded audio data; and 

5 a file directory, the file directory including a 

6 copy of the index information included in each one of the 

7 plurality of data files. 

1 26. The digital data storage device of claim 25, 

2 wherein each of said plurality of data files 

3 includes encoded image data and wherein said index 

4 information included in each data field includes image 

5 content information. 

1 27. The digital data storage device of claim 26, wherein 

2 the image content information in at least some of the 

3 plurality of data files includes image content information 

4 added to the data file after the initial creation of the 

5 data file. 

1 28. The digital data storage device of claim 27, the 

2 encoded image data included in said plurality of data files 

3 is encoded using a plurality of different image encoding 

4 formats, the encoded image data in each particular data 

5 file being encoded according to a single image encoding 

6 format . 
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1 29. The digital data storage device of claim 28, wherein 

2 the plurality of different image encoding formats are 

3 encoding formats for which public standards exist. 

1 30. The digital data storage device of claim 29, wherein 

2 the plurality of different image encoding formats include 

3 MPEG- 2 , JPEG and DV. 

1 31. The digital data storage device of claim 29, wherein 

2 the index information included in each of the plurality of 

3 data files is encoded according to the same encoding 

4 format . 

1 32. The digital data storage device of claim 31, wherein 

2 the format used to encode said index information is not a 

3 public standards based encoding format. 

1 33. The digital data storage device of claim 31, wherein 

2 the index information is included in each data file in a 

3 manner that results in the index information being 

4 discarded when processed by a decoder which does not 

5 support decoding of the format used to encode said index 

6 information. 

1 34. A method of processing an encoded data file, the 

2 method comprising the step of: 

3 searching the encoded data file for content 

4 information which can be obtained by examining encoded data 

5 included in said file without fully decoding said encoded 

6 data; 
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7 retrieving from the data file encoded data 

8 satisfying a set of search criteria; and 

9 fully decoding the retrieved encoded data. 

1 35. The method of claim 34, wherein the step of searching 

2 the encoded data file includes the step of: 

3 performing a variable length decoding operation 

4 to produce data including DCT coefficients; 

5 examining the DCT coefficients to determine if 

6 the search criteria are satisfied. 

1 36. The method of claim 35, wherein the step of retrieving 

2 from the data file encoded data includes: 

3 retrieving one but not all of a plurality of 

4 encoded data streams included in said encoded data file. 

1 37. The method of claim 36, wherein the step of retrieving 

2 from the data file encoded data includes: 

3 retrieving some but not all of the encoded data 

4 included in an encoded data stream. 

1 38. The method of claim 34, further comprising the step 

2 of: 

3 performing an indexing operation on the decoded 

4 data produced by decoding the retrieved encoded data to 

5 thereby generate indexing information; and 

6 storing the indexing information in the data file 

7 from which the encoded data was retrieved. 

1 39. A method of indexing encoded information, the method 

2 comprising the steps of: 
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3 retrieving encoded information from a data file; 

4 performing a partial decoding operation on the 

5 encoded information to generate partially decoded data; and 

6 performing an indexing operation on said 

7 partially decoded data to generate indexing information. 

1 40. The method of claim 39, further comprising the step 

2 of: 

3 storing the generated indexing information in the data 

4 file from which the encoded information was retrieved. 

1 41. The method of claim 39, wherein the step of performing 

2 a partial decoding operation includes the step of: 

3 performing a decoding operation to generate DCT 

4 coefficients from the encoded data; and 

5 wherein the step of performing an indexing 

6 operation includes examining the DCT coefficients to assess 

7 the information content of the retrieved encoded data. 

1 42. The method of claim 40, wherein the step of storing 

2 the generated indexing information includes appending the 

3 indexing information to said data file. 

1 43. The method of claim 39, wherein the step of retrieving 

2 encoded information includes: 

3 retrieving one but not all of a plurality of 

4 encoded data streams included in said encoded data file. 



1 44. The method of claim 39, wherein the step of 

2 retrieving from the data file encoded data includes: 
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3 retrieving some but not all of the encoded data 

4 included in an encoded data stream. 



